(19) 





(12) 



(43) Date of pubficaton: 

08.05.1996' Bulletin 1996/19 

(21) Applicalion nunnber:9511678a8 

(22) Dateoffning:;25.10.1995 



Europdlsches Patentamt 
European Patent Office 
Office europ6endes brevets (11) EP0 711 079A2 

EUROPEAN PATENT APPUCATION 

(51) IntaS:H04N7/50 



(84) Designated Contracting States: 
DEFRGBIT 

(30) Priority: 04.11.1994 US 334282 

(71) Appficant RCA Thomson UcenslngCor^ 
Princeton New Jersey 08^ {U^^ 

(72) Inventors: - 
. Kwok; Wilson 

Plainsboro, NJ 08536 (US) 



• Sun, Huifang- 
Cranbury.NJ 08512 (US) 

• Zdepsld,Joel\Afatter 
Mountain, CA 94043 (US) 

(74) Representative WOrdemann, Henne^ bipUng. el 

DeutsAe Thoms6r|-.Brandt GnibH, 
Patent Depi, 
GatUniger Chaussee 76 
&30453 Hannover (DE) 



(54) Method and apparatus for scaling a compressed video bltstream 



(57) A mettibd and apparatus for scaBng the bil- 
stream of a compressed video signal includes partial 
decoding hardware (38, 41) to permit excising of higher 
frequency AC DCT coefficients or re^^uantizing quan- 
tized data wrth a coarser quantization factor. The scafing 
is performed on a block (macroblod^ basis in a manner 
which linearly scales the amount of compressed data per 



l)lock. An analyzer (40) generates a profile of cumulative 
partially decompressed data over a video frame, and bit- 
stream seating (42) is performed in a manner which 
insures that a profSe of the scaled signal substantially 
comports with the prof fle of the original data. 
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Description 

This invention relates to apparatus for redudng the amount of data in a previously compressed video signal bit 
strecim. 

s The moving picture experts groi^ (MPEG) video coding standard has been proposed for a vari^ of appucatons 
for video transmission and storaga Several applications such as Video On Demand and Trick-Play on Track Digital 
VTRs, for example, are more easDy facflitetiBd with a compressed signal having a lesser bitrate than that provided in 
certain of the MPEG profiles. The different appfications have slightiy cfifferent signal requirements, however a similar 
scaling apparatus may serve to reduce an original bitrate to a rate conducive to a respe^ 

10 An MPEG coding standard has now been developed for a variety of applications which include terrestrial high def- 
inition television (HDTV), teleconferencing, satellite communication, direct broadcasting systems (DBS) and multimedia 
workstations. An MPEG-2 coripressed bit stream may represent a conpressed HDTV bit sfream of relatively high data 
rate. If this sigial is to be ublzed on relatively nanw band channels it is necessary to reduce or scale its data down to 

a lower bit rate. ~ , ' ^ 

15 Consider a Video On-Denr»and system wherein a video file-server 

MPEG encoded bit streams. The bit streams stored in the library are originally coded at a higli quality (e.g. studio quality). 

A nunijer of clients may request retrieval dTarty of these video programs at one particular tima The number of users 

and the quality pf videadeBvered to the users is constrained by the Outgoing channel capacity. This outgoing channel, 
* vvhich may be a cable Ixis or.an ATM trunk for example, must be shared among the users who are' granted, service. 
20 Differert users may require differert levels Of video 

fraction of the total charinelcapadty allocated each user. . 

. To simultaneously accofrinodate a phir^ of users, the* video fOe saver may scale the stored bit streams to a 
reduced bH rate before they are delivered over the channel to the respective users. The quality^of the resulting scaled 
bit stream should not be signHicantly degraded compared to the quality of a hypothetical bit stream obtained by coding 

25 the original source material at the reduced rate. Complewty and cost is not a critical factor because only the f Se server 
has to be eqiipped vnth ttie scaling hardware, not respective users. 

* In Trick-play on Track Digital VTRs systems, the vWeo is scaled to create a side track on video tape recorders. This 
sWe track contains very coarse quafity video suTicient to facilitate frick-modes on the VTR (e.g. fast fonrard and reverse 
scan at different speeds). ConplexSty and cost of scaling hardware anduded in these devices is of significant concern, 

30 because the VTR is a mass consumer Hem subject to mass prociictioa 

Anotiier appOcation of scaTing is Extended-Play Recording on Digftal VTRs. In this applicatioa video is broadcast 
to users homes at a certain broadcast quaTity (-6 Mbps for standard drfinition video and -24 Mbps for high definition 
vkJeo). Withascalingfeatureintheirvideotaperecorders, usersniayrecordthevideoatareducedrate. aWntoexlerided 
play, EP, mode on toda/s VHS recorders, thereby recording a greater quantity of video program material onto a tape at 

35 lower quafity. ^ «^ 

In scaling, the hrgher quality of the information in the original signal should be exploited as much as possible, and 
the resulting image quafity of the new signal witii a lower bit rate shouW be as high as possible, or as close as possible 
to one created by coding the original source vkJeo at the reduced rate, tlis assumed tiiatfor a given data rate the original 
source is erxxxted in an optimal way. ... 

40 The method and scafing apparatus of the present invention ndudes partial decoding hardware to permit excising 
of higher frequency AC DOT coeTidents or re^iuantizing quantized data vrith a coarser quantization factor. The scaling 
is performed on a block {maaoWod^ basis in a manner which finearty scales the amount of compressed data per block. 
An analyzer generates a profile of cumulative partially decompressed data over a video frame, and scaling is perfonned 
to insure that a profile of the scaled signal substantially conports wHh tiie profile of the original data. 

45 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention wiD be descrbed with reference to the drawings wherein; 

so FIGURE 1 is a block diagram of a prior art scaling apparatus: 

FIGIJRE 2 is a block diagram of a scaling apparatus embodying the present inventi 

FIGURE 3 is a diagram of an exenplary proffle of cumulative partially decompressed data representing original and 
scaled compressed data; 

FIGURES 4-5 are block diagrams of alternative scaling apparatus embodying the present invention; 
55 FIGURE 6 is a flowchart of the method of operation of the FIGURE 2 apparatus; and 

FIGURES 7 and 8 are flow charts useful in understanding the method of operation of the FIGURE 4 apparatus. 

FIGURE 1 iUustrates a known compressed video signal scaling apparatus for reducing the amount of data in a 
previously coded video signal. In tiie illustrated apparatus only the major functional elements are shown to convey the 
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general operation of the circuitry. For exanrple compressed video signal indiides various types of data, only some of 
whidi types are quantized The other types are shunted around the rerquantization or scaling apparatus and remutti- 
plexed with the scaled data in the multiplexer 14. It will be apparent to one stalled in the art of conpression drcuitry that 
the muffiplexer 14 must include rKit insignificant control drcuitry to perform this function. However one skaied in the art 
5 of conpression drcuitry will readily be able to realize the mutfiplexing function of multiplexer 14. thus it will not be 
descrbed herein. 

In FIGURE 1 previously compressed or coded video signal wtiich is to undergo scaling is assumed to be a block 
coded signal wherein respective pictures are divided into a pluraTrty of blocks or macroblocks, and compressed on a 
block by block or macroblock tiy macroblock basis, with the resulting signal occurring, at least in part, as a stream of 

10 coded blocks or maaoUocks. At least part of the data in respective maoroblocks is quantized and variable length 
encoded. Examples of such a compressed signal are MPEQ1 and MPEG2 video signals. The coded signal is appGed 
to a variable length decoder 10 which produces a variable length decoded signal Motion vectors (arxl other non-quan- . 
tized codewords) induded in the compressed signal are shown being diverted around the succeeding drcuitry (Q~i 1 1 ; 
Q 12: VLC 13), but in fact they rnay b»e passed through the succe^ing ctrcuitry if such drcuitry can be conditioned to 

IS ijetrarisparent to signal cofTiponerits which shodd not be altered by the s 

After variaiie length decoding, the decoded codewords are coupled to an inverse quantizer 11, wherein signal 
components which were quantized in the compression process are de<|uantized. The de-quantized components are 
re-quantized, in a quantizer 12 under the control of a rate controQer 1& The rate controller 16 fs adjusted to produce 
coded signal having a bit stream scaled in conformance with the desired reduced rata Scaling is accomplished in this 

20 instance by the rate contrdler provkfihg quantization values to th» quantizer 12 which produce a.coarser quantization 
of respective codewords than the originahooirnpressor. The re-qucvitized codewords are variable length coded in a var- 
i^e length encoder VLC 13, and reformatted in the multiplexer 14 witfi signal components which did not mdergore* 
quantization. The reforiratted signal is applied to a rate buffer 1 5 which, in general, converts a bursty signal to a constant 
rate signal. The rate buffer includes ah occupancy monitor which provides a control signal for controlGng the rate buffer 

25 to concBtion the quantizer 12 to provide a constant rate signal. A more detailed description of this drcuitry is available 
in an artide. REDUCTI0l;4 OF THE BIT RATE OF COMPRESSED VIDEO WHILE IN ITS CODED FORM, by D. G. 
Monrtson et al.. PVW, D17.3. 

For MPEG compressed video, quantization involves a matrix of quantization values and a quantization factor. The 
matrix of quantization values are detemmned according psychovisual parameters. The matrix of quantization values 

30 indudes a respective value for each DOT coeffident in a biock of coeffidents representing a block of pixels, and the. 
matrix Is normaOy' used in common to quantize all macroblocks in a frame. Quantization factors, on the other hand are 
macroblock specific that is each quantizing fector only applies to the macroUockto which it is assigned. The quantizing 
factors are used to weight all c^iantizing values in the matrix before the matrix ts used to quantize a respective macroblock. 
In the following desoptioa references to the generation of quantizing parameters are meant in general to apply to the 

35 generation of the aforedefined quantizing factors. 

The system illustrated in FIGU RE 1 , in general, cannot provide uniform bit scaling over an image due to the variability 
in the variable length coding. In other words the bit scaling of respective macrobkxte may differ by a signif icant percent- 
age. The bit scaring drcuitry of the FIGURE 2 and 4 apparatus does provide sut^stantially uniform bit scaling from mac- 
roblodctonnacroblock. . 

40 Refer to FIGURES 2 and 6. In FIGURE 2 coded video signal, which is to undergo scaling, is applied to a variable 
length decocfing parser 20. The parser 20 is transparent tp codewords which are not variat)le length coded and passes 
them unaltered. Variable length coded codewords, in for exanrple an MPEG signal, do not have ddined boundaries. 
The parser 20 determines {602} the boundaries of respective codewords arxl iderrtif ies the codeword by type. The code- 
word is not actually decoded. The parsed and non-variat)ie lengtti coded codewords are tagged witii identifiers and 

45 stored {603} in a delay memory 21. 

The parsed arid norvvariat>le length coded codewords are epplied to an analyzer 22. The analyzer 22 develops a 
profile ot in this example. AC discreet cosine transform (DCT) coeffidents versus macroblocks over respective com- 
pressed frames (or fiekis or images etc.). That is, the analyzer generates {605} the running sums of AC DCT coefficient 
t>its on a macrobkx:k basis. The analyzer 22 stores {604} the respective sums identified t>y macroblock number in a 

50 memory 24. For macroblock 1 (MB1), the sum is the sum (EMB1) of all bits in MB1 corresponding to the AC DCT 
coeffidents in MB1. For MB2 the sum is the sum (LMB1) plus the sum (£MB2) of all bits in MB2 corresponding to the 
AC DCT coeffidents in MB2. For MB3 the stmn is (ZMBI) + (2:MB2) + (I:MB3) etc. FIGURE 3 illustrates an exemplary 
graph (designated PROFILE) of such sums with the macroblock nunt)er.as ordinate. 

In addition to the foregoing sums of AC DCT coeffidents the analyzer counts {601} all coded bits (TB) for respective 

55 frames. After all maaoblocks for a respective frame have been analyzed {606}, a target value. TVac. of AC DCT bits per 
frame is calculated {608} using the sums (TB) and (LMB last), according to tiie relationship 

TV = (^'^S last) -% times(TB) - excess 
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where p^B last) is the last of the AC sums and corresponds to the totel number of AC DCT fc»ts in the frame, % is the 
percentage bf which the bit stream is to be reduced, and "excess' is flie amount by wKch the previous frame missed 
the desired target 

The profile of AC DCT bits is scaled {610) by the factor TVac/(EMB last). Scalwig is performed by multiplying each 
5 of the respective sums (JIMB 0 by the factor TVac/(EMB last) to generate the Dnearty scaled profile shown in FIGURE 
3. The respective sums (1MB 0 are replaced by the scaled sums in the men(X>ry 24. 

After the profie has been scaled, the respective parsed and non-variable length coded codewords are accessed 
from the memory 21 a macroblock at a time. Non AC DCT codewords are passed {612} to a buffer 23, which essentially 
reasse^rnbles {618} the output The analyzer 22 conditions the menrwiy 21 to pass codewords to ttie buffer 23, and 
10 conditions the buffer 23 to accept a Bmited amount of codeword k)itsper macroblock. As the AC DCT codewoitte are 
accessed, the bits of the respective AC DCT codewords are summed {614} and the current sum for r^ective macrob- 

• locks is cdntinuously compared {61 6} with the scaled sum for that macroblock less thanumber of bits corresporiding to 
an end of Uock EOb! codeword. Respfective AC DCT codeworids are accepted by the buffer 23 until the current sum of 

• macroWockbfts is equal to or exce^ the oorresjionding scaled sumtes EOBbfts. VVhen tius condition occurs an EOB 
15 code Is iriserted {620} into the bit stream, and tiie remaining codewoitte for tiie respective maaoblock are discarded 

{622}. This prxxiess continues until all coded data for a respective frame is reasserrWed Into the scaled bit stream. 

It should be noted that an MPEG macroblock ncludes, for example, six blocks of data. aD of which may include 
corresporiding AC DCT codeworda In processing data from the memory 21, corresponding codewords from each of 

• the blocks within a respfective macroblock sboukJ be accessed in pardel rather thain sequerrtially so that eAch block in 
20 themacroWockisgivenequalbitspacaAssuningthatrespe^ 

ACfc where i denotes tiie coeffideht(1-64) and k dWesm 

order ACn. ACia AC13, AG14. AG15. ACie. ACaii'ACza. AC^. ACi;^.' AC25.' AC25, AC31; ACaa AC33, AC34. AC35. AC36. 
AC41 etc. This requires that the buffer 23 be partitioned on a block bass to pecmil forming r^ective blocks in parallel 
v^ichwfll then be read sequentially • • 
25 sincebils'areread'frDmmemo721 uptotiiepoirtvvheretheramiberofbi^ 

nuntfDer of AC DCT bfts represerited by the Imeariy scaled proWe; eadirdthe respective macroblocks wfll be substantially 

linearly bit scaled. .-ly-.. m.-^ 

FIGURE 4 illustrates a second en^odiihent which performs bft scafing by re-quantizatK)n. Unlike the FIGURE 1 
apparatus however, the FIGURE 4 apparatus peribnrns substantiaBy Bnear bit scafing of respective nracroblocks. In 

30 FIGURE 4, coded video signal is applied to a variable lengtti decoder 38 which decodes those signal components which 
are variable length encoded. The decoded signal fe appGed to a delay memory 39 (which stores the decoded signal until 
ansOyas is permed) and to ari analyzer 40. The output off the memory 39 is coupled to an inverse quantizer 41 . Note 
that signal coirponenls which are not quantized m^ be shunted aitnmd ttie Inverse quantizer 41 . vrfiich is represented 
by tti e arrow from meiTiory 39 to ttie niJltipl exer 44, or tti^ may be praaed th^ 

35 circuitry, iff ttie inverse quantizer and ^cceeding drontry may be concfifioned to be fransparent to norvquantized signal 
components. NoteaIsottTatttieinversequantizer41 maybepositionedalieadolthedelaymerTiory39rattierttian after 1^ 

Inversequantizer41 de^iuantizesttiose signal coirponents which are quantized, and app 
42. Quantizer 42 is concfitioned by ttie analyzer 40, to more coarsely qiantize ttie signal connponents which are nonrally 
quantized, to effect brt stream scaling. The re^quantized signal is appfied to a variable length encoder 43 which variable 

40 length encodes tiie signal and appfies it to a multiplexer 44 wWch refomiats the signal accortfihg to the original protocol 
or rf desired to a cfifferent protocol. The reformatted signal is applied to a rate buffer 45. 

In one entKxfimenl off the FIGURE 4 apparatus, a rate controller 47 (shown in phantom) is employed to control re- 
quantizatioa In this enixxfiment, ttie analyzer appfies control paramrfers to tfie rate controller on a frame basis and 
thereafter ttie rate controfler confrols ttie re^^uantization process. The assumptton fe made ttiat ttie rate controller is of 

45 the type virfiich errploys a frame target bit size to generate quantization factors ior respective macroblocks. In suc^ rate 
controllers, ttie frame target bit size may either be calculated by ttie rale controller itself or applied from an external 
source. An example off ttiis type off rate controller is described in Ur^ States Patent 5,144.424 entitied APPARATUS 
FOR VIDEO DATA QUANTIZAIDN CONTROU by Tristan Savatier. The controller in this patent generates a parameter 
TSizeJ (ttie index i designates I, B or P frames) which is utilized in calculating respective quantization factors for frame 

so I For present purposes it is assumed ttial such a rate controller be modified to accept a target parameter TSizeJ 

from ttie analyzer 40. wi -i-. \* 

The analyzer 40, in ttiis instance, extracts ttie quantization factor Qmbi from respective coded macrot>locks and 
counts ttie respective bits MBj for respective macroblocte in ttie data stream provided by ttie VLD 38. It forms ttie product 
QMBi(EMBi) of ttie sum of tMts times ttie quantization factor associated witti ttie macroblock. Sums. EOwBiC^BOi. of ttie 
55 products generated for all previous macrodbcte for a respective frame are tomied for each macroblock and 'stored in 
ttie memory 46 identified by macroblock number; where EQMBiPMBdi >s equal to QmbiCEMBi); raMBi(^Bj)2 is equal 
to QmbiP^Bi) + QmkC^Bz) etc. These sunris plotted against macroblock number form a normalized profile similar to 
ttie exanple illusfrated in FIGURE 3. Note however ttiat ttiis proffle r^tes to total bits not only AC DCT bits because 
tiie rate controller operates on a total bit basis. Aprotae of AC DCT bits may also be used if ttie resulting target value is 
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appropriately alimented tor the non<»anfized6igr«I component 
^^Same target valueTSizaJwhichIsappr»d to theratecontma^ 

Se^Si decoded signal is then accessed ftom delay memory 39. de^viant^ed. and reK,uant.2ed by quanbzer 
«u1Se^SJo. Of the rateWdler 47 uiazing the calculated val^^ 

me controller operates wHh a volume of bits, not nomialized t*s. Thus the scale factor SF ,s .n urrrts of 1/Qmb to 
pr^e a target In units of bits. An exenplary scale factor SF maybe calculated according to the formula 

(1 ■%)(££ MBi) last -excess 
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Where (XXMpJiart corresponds to the total bite in the respective original framesaw is the amountof bitein access 
rfthetS^^eforftepreviousframe..A^ 7 %y QMBtavg. «here 

°"^r^'ml1fRS?R?^ 
enisodimentthe analyzer 40 appBesquaitofionfactorst 

47 is nbt used in this embodllnenL AU of the other elemente except the rata controller operate as described above. 

Referring to FIGURE 7 coded video signal is variable length decoded {702) and the decoded signal is stored in the 
mem^^ S^ied to the analyzer S^a bte of respective macrcblod« are summed ^^B, W and ttienm^- 
S77071 bylEe original- quanlizalion factor Q„b. associated with. the '«=P^« 'j^^^^^'^*" ^ JSSS" 
SrCEMBO ^cumulatively summed {708} and stored (709) in the mernory f6 identfied respe^e - J.^*'"^^ 
?yeacc.Sidatedsums^<W»^).**enc^^ 

orofiles shown In FIGURE 3. When the lasl maaoUock is processed [7101. the prof ie is scaled {712} By."]^ ^tefi^ 

factorSF asd^Bied abova ThrsIs accomplished by moltifrfyirig each a«»«T»rta\ed5um dprqducJE^ 

Se sSing fador SF ahd storing them in ihe memory 46 identified with respective macroWocfe. The decoded vrfeo 

S^nSuirhemo.y39tetheninve«e(nianfized{714)andre^uar^ 

with the scaled profn& This process is iHustiated in FIGURE 8. • . , , „ ■ 

In FIGURE 8 a new quantization factor Q„«E maaobid* i fe eslin«ted t^OO^ ^he ^"^^^ J^^'g'**^"?^ 
vfa a variety of methods. One method of obtaining the estimate is to fonn Qmbe = (QmbiV(1 - %) where Qmh is the 
original quantizing factor for'macrobloek L Another method is siinply Id use the quanH^on ^^^^^ '^^^^ 
Se CwTis fte quantization factor generated for the prwious macroUock 1-1. Alhiri method of eslHO^ngthe 
^ZS^^. is to use the fLl quantization factor. Q„BiF. calculated for the corresponding macn*lock of 

*^'SHSSe'!Lrte*:S;equan«zaB^ 

{801}fromthem^ry39.»tocroblockMBiisquantized{802)uslngtheestima^ 

engii «3ed {803). The new total of bite. IMB^ far the macrcblocK are summed {804}. arrf the codeworcte of fte re- 
SSzS^croblock are reassen«ed {805). The sum of bite IMB^ is summej {806} wjth the sunr« 
Quantized macroWocks to fomi a profile value E(rMB,J), for the arrent macroUock of the re<,uanbzed receded bit 
streanv Note that this proffle is of bite and the scaled profile Is described in termso^ reMB«.^is 
The difference between thenewprofievaluerCEMBiJ), and the original scaled profile value. SFC^QmbiP^^B^W '« 
calculated {807} to generate a liit error vahie AE. where 

AE » SF(E(Q MBi(^MB ,)),)- ECSMB ,. 

The enorAE is compared with a threshold value AEt {808}. H the error is greater than the threshold a new quantization 
factor QMBin«w is calculated {809}. An exempfary calculation for QMBin«, according to a relationship of the term; 

QMBk«»-QMBi*s9n(AE) 

where Qmbi in the brackete corresponds to the last quantization factor used for the ith macroWock and is equal to Qmke 
in a fiist pass, and sgn(AE) is equal to ±1 far AE being positive and negative respectively. MaaoWock i is 'eaocessed 
{801} andreqiianliz^ using the nw quanlizalion factor. Steps {801 -809) are iterated until the error AE « less than the 

*^'°A?^ (808) if the error is less than the threshold, a check {810} is made to detemtine if all of the macroWocks in 
the framehave been requantized. If they have not. the index i is incremented {81 4} and the fj^^^^^^^^ 
macrobkxk i+1 is initiated {800). H they have then the system jumps to step 700 and processing of the next frame is 

'"""Ihe foregoing process tends to rigidly track the profile and aBows very little variation in the QMSfS- "^^^^Jf 
factors are very uniform over a frame. Note for each subsequent processing pass for a particular macroWock. the date 
wN^vlreaLembled {805} tor the prior processing pass of that macroblock is discarded. Onlym 

of the f nal pass is retained. 
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The dashed arrows, in FIGURE 8 are included to describe another (preferred) embodiment which provides accept- 
able performance and is less conputationally intensive. In this further embodiment, the QmbtS terxl to vary more resulting 
in a more uniform subjective image quaGty. In brief, this further embodiment is a one pass process wherein respective 
macroblocks are requantized with respective QmbtS detemiined using the errors AE calculated for the respective previous 
5 macrcWodc 

In this furtha- eirtxxiiment, at step {800} an estimated nominal quantizing factor is generated for only the first mac- 
roblock processed in the frama An exenplary nominal quantizing factor Qn may be calculated according to the rela- 
tionship 

Out is thQ nominal quantizing factor used in the previous frarne,- (AE)l is *ie error for the last macroblock in the previous 
frame and g is a gairi factor. A*non^nal.gain factor g is 31/Bpp^ 

R coding rate 

• '^pp "picture rate' . . ' 

For the very first frame to be processed the value On rnay be arbitrarSy selected to equal a midrange quantizing factor. 
J An alternative method of selecting a nominal quantizing factor for the frst riiacroblock of each frame is to calculate tiie 

average of afl o< the new quantizing factors gene^^ 
20 . OnceftienorTMnalquanliangfaplorQN rmcroWockMBiJ.sa<x:essed {801} from mempry 39and 

: qiiarrtiz^ {802} usfaigON* Steps {803-8Q7) are performed as described abova However in this embodiment step {808) 
is eRnwiated. and a new QMehw fe calculated {809} regardless « the valpe of the enror calculated in.'step {80^). The 
new quantizing factor is calculated according to the function 

+ g(AE))K 

where QMSnanf-i "s the value of Qmbww calculated for the previous macroblock (is Qn for the first macroWod^, and K is 
a scaling factor normally in the range of [0.5, Z.OJ which reflects the amount of subjective toleration far quantization 
errors, arid niay be obtained from irrtracoding of rnacroWocks. 

30 Afterthe value of QMBn«», is calculated a check is made {810} to detennine H the last macroblock in the frame has ^ 
been proce^ed. If it has not. the macroblock ind©c i is incremented {814) and the next macroblock is accessed {801} 
from memory 39. and qiiantized {802} using the calculated value Qmbow- S^eps {803-810} are performed and the next 
macroblock is processed eta. To review this enixxfiment, after the original profile is generated{700-714}. quantization 
is a single pass process where the connected quantizing factor Qmh determined with respect to each macroblock i at 

35 step {809} IS used to quantize the subsequent macroblock H-l. 

FIGURE 5 illustrates a further bit scaling apparatus which requires considerable hardware to perform the bit scaling. 
In this apparatus the coded video signal is completely deconpressed in a decompressor 50. However motion vectors 
for respective macroblocks are saved in a memory 52. The decompressed video signal is applied to a conpressor 51 
which re-coirpresses the video signal. The compressor 51 utilizes the nwHon vectors obtained from the original com- 

40 pressed video signal, hence the compressor 51 need not include motion vector calculating apparatus. The conpressor 
51 is programmed to produce a compressed bit stream at tiiedesired bit rate. A bit profile may be generated to calculate 
a target value and applied to the rate controOer witHn the compressor 51 . 

Claims 

Apparatus (38-47) for scaling the bit stream of a conpressed video signal which has been compressed on a block 
basis, said apparatus characterized by an analyzer (40) for determining a cumulative profile of coded bits of said 
compressed video signal on a Ijlock t>asis, and bit stream scaling means (38, 39, 41 ,42) responsive to said analyzer 
for generating a scaled bit stream wWch is linearly scaled with respect to said profile on said block t>asis. 

The apparatus set forth in claim 1 characterized in that said analyzer comprises: 
a connection for applying said corrpressed video signal; 

a processor coupled to said connection for g enerating a sum JMBi representing a quantity of bits of respective 
said blocks of said compressed video signal and a further sum ETMBi corresponding to an accumulation of sums 
ZMBj of blocks from a first block to block i, and for scaling at least one of said sums IXMBi to produce a signal to 
control said bit stream scaling apparatus. 

The apparatus set forth in claim 2 characterized in that said analyzer scales said sums IXMBj for respective said 
blocks, and said bit stream scaling apparatus includes a means for selecting quantities of bits of said compressed 
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video signal bits for respective blocks, which quantities are d^ennined for r^ective blocks according to a con-e- 
spondng scaled sum m/lBi. 

The apparatus set forth in claim 1 characterized in that said bft stream scaling apparatus Comprises the cascade 
connection of a variable length decoder, aninverse quantizer, a quantizer responsive to quantization factors provided 
by said analyzer, and a variable length encoder. 

The apparatus set forth in claim 4 characterized in that said analyzer Includes means for forming a profne of bits of 
cod^Iondte of said corrpressed video signal on a block basis; means for scaling said profBe to generate a scaled 
proffle- means for fonning a new profBe of bits of codewords of compressed video signal provided from said vanaWe 
length'encoder on a Wockbasis; and means tor generating quantizatfon factwsfbr controlling quantization of respec- 
thre«aid blocks from differences between said scaled profBe and sa^ 

The bil siream scaEng apparatus set forth in Claim 1 , characterized by: . 
a connection for accesang sakl cornpressed >adeo slg^^ 

saki bit stream scaling means includes: , > 

a cascade connection of a variable length decoder (38), an inverse quantizer (41), and a quantizer (42). said 
quantizer having an input port for applying quantization control signal and an output port for providing quantized 
- signal, and said cascade connection being coupled to said connection fb^ 
2a saki analyzer(40) having a first input port coipled to saw connection^ 

• - signal a second inputport«)ipled to sakI output port of 

• saklquanlizationcontrdsignal.saklanaiyzergeneratingsakiqu^ . 
based on differences between a fffst fwiction of accumulated bits occuning m said compressed video signal and a 
second function of accumulated bits in signal coupled to said second input port 

7. The bit stream scaling apparatos set forth in daim 6 characterized in that said analyzer is covfied to the output pprt 
of said qusLntizer with a variable lerigth encoding drcuit 

8 A method for redudng the bits in the bitstream of an MPEG coded video signal characterized by: 

fonning (700-71 0) cumulative sums of bhs of macrobtocks of sakJ MPEG coded video signal on a macroblock 
by macroblcKkljasis over an image; 

forming (712) a scaled version of saki cumdative sums; 

processing (800-809) said MPEG coded video signal such that cumulative sums of bits of macroblocks of 
processed saki MPEG coded video signal on a block by Wodc basis are siiistantially equivalent to said scaled 
35 verskxi of saki cumulative sums. 

9. The method set forth in daim 8 characterized in that the step of processing comprises discarding bits of respective 
macrotiocte, 

40 10. The method set forth in daim 8 characterized in that the step of procesdng comprises: 

selecting respective codewords of said MPEG coded vkieo signal from respective macroblocks and forming 
new cumulative sums of bits of ones of said codewords which were selected on a macroblock by macroblock basis; 
and 

temiinating the selection of codewords for respective macrotrfocks when saki new cumulative sums of bits 
45 £U'e substantially equal to saki cumulative sums of bits. 

1 1 . The method set forth m daim 8 characterized in that the step of processing comprises: 
inverse quantizing quantized codewords of said MPEG coded video signal; 

quantizing inverse quantized codewords of saki MPEG coded vkieo signal with estimated quantizing param- 

50 eters; . _. ^i. 

forming caimulative sums of bits of macroblocks of saki MPEG coded video signal quantized with said esti- 
mated quantizing parameters; 

determirang new quantizing parameters, on a macroblock basis, as a function of differences between said 

scaled verskin of cumulative sums arxl sab new sums; . 
55 quantizing inverse quantized codewoids of said MPEG coded video signal with saki new quantizing param- 

eters. 
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12. The method set forth in daim 8 characterized in that the step of fonrtng cumulative sums of bits of macrobiocks of 
said MPEG coded video signal on a maaoblock by macroblock l>asis conprises fonning cumulative sums of only 
bits which represent AC DCT coefficients. : 

5 1 3. The method set forth in daim 1 2 characterized in that the step of forming a scaled version comprises: 

calculating a target value for bits of AC DCT coeff idents for respective frames responsive to total bits of said 
MPEG coded video si^ial for respective frames; 

generating a scaGng factor equal to the ratio of the target value divided by the cumulative sum for the last 
macroblock hi a frame. 

10 • ■ ' 

14. The method s^ forth in dairn 8 characterized in that the step of toming cumulative sums of bits of macrobiocks of 
' said MPEG coded video signal on a macrobkxdc by macroblock basis comprises: 

detecting quantizirig values assodated vvith respecth^e 

summing bits of respective codewords for respective macrtblocks; and 

multiplying the sum. d bits for a respective macroblock with its assodated quantizing^ue to generate a 
product of bits summed times the quantizing valua 

1 5. The method set forth in daim 14 characterized in that the step of forming cumulative sums of bits of macrobiocks 
of said MPEG cod*l video dgnal on a macroblodc by macrobfodc basis further comprises, for respective macrob- 

20 lod« forming'thasum of preceding-and current said products, 

16. The method set forth Is daim 15 characterized iri thatthe step of fonnnig a sc^ed version of said cumuIativiB sums 
comprises multiplying respective cumulative sums by a-faclor SF where • 

_ (1-%)(£SMBt) last -excess 

■ x{QMBi{^MBoita* - : 

and wherein % Is a percentage of bits the bitslream of said MPEG coded video signal is to be reduced. n:„Baa»t 
con^esponds to the total bits in a frame. 2:(QMBiP*iBD)iast « a cumulative sum of products of respective quantizing 
factors times the corresponding sum of bits for respective macrotrfocks, and excess is the anrxxjnt by which tiie 
30 previous frame exceeded a desired bit target 

17. The method set forth in daim 8 characterized in that tiie step of processing conprises: 

a) inverse quantizing quantized codewords of said MPEG coded video signal; 
35 b) quantizing inverse quantized codewords of a first macroblock off said MPEG coded vkleo signal with an 

estimated quantizing parameter; 

c) fom^ng a new sum of bits of said f irst macroblock quantized with said estimated quantizing parameter; 

d) determining a newquantizing parameter as a function of the difference t>etween saki scaled version of cumu- 
lative sums for tiie current macroblock and said new sum of bits; 

40 e) quantizing inverse quantized codewords of a next subsequent macroblock of saW MPEG coded vkieo signal 

with saW newquantizing parameter; 

f) forming a new cumulative suni of bits of all preceding and said next subsequent macroblock quantized with 
saki estinnated quantizing parameter or said new quantizing parameter; and 

g) repeating steps d through f for ail remaining nriacrcblocks in a frame. 

45 ' . 

1 8. The mettiod set forth in daim 1 7 characterized in tinat the step of determining a new quantizing parameter comprises: 

generating the difference AE between said scaled version of the cumulative sum for a respective macroblock 
arxJ saki new cumulative sum of bits; 

multiplying tiie difference AE with a gain factor g to generate the product <g)(AE); and 
50 containing tiie product (g)(AE) with the quantizing factor used to quantize the current macrok)lodc 

19. The method setforth in daim 11 characlerizedinttiatthestepofdetenmininganewquantizingparameterconnprises: 

generating the difference AE between saki scaled version of the cumulative sum for a respective macroblock 
and saki new cumulative sum of bits; 
55 multiplying tiie difference AE whh a gain factor g to generate the product {g)(AE); and 

corrijining the product (g){AE) with the quantizing factor used to quantize the current macroblock. 
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